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ABSTRACT 

We show that the following problems are decidable in a rank 2 free group : does a 
given finitely generated subgroup H contain primitive elements? and does H meet 
the orbit of a given word u under the action of G, the group of automorphisms 
of i<2? Moreover, decidability subsists if we allow H to be a rational subset of 
i*2 , or alternatively if we restrict G to be a rational subset of the set of invertible 
substitutions (a.k.a. positive automorphisms). In higher rank, the following weaker 
problem is decidable: given a finitely generated subgroup H, a word u and an integer 
k, does H contain the image of u by some fc-almost bounded automorphism? An 
automorphism is ^-almost bounded if at most one of the letters has an image of 
length greater than k. 
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Orbit problems in general concern the orbit of an element u or a sub- 
group H of a group F, under the action of a subset G of AutF. Conjugacy 
problems are a special instance of such problems, where G consists of the 
inner automorphisms of F. In this paper, we restrict our attention to the 
case where F is the free group Fa with finite basis A. 

In this context, orbit problems were maybe first considered by Whitehead 
[26] . who proved that membership in the orbit of u under the action of 
Aut Fa is decidable. The analogous result regarding the orbit of a finitely 
generated subgroup H was established by Gersten [7j. Much literature has 
been devoted as well to the case where G = ((f) is a cyclic subgroup of 
Aut Fa, e.g. Myasnikov and Shpilrain's work [15] on finite orbits of the form 
(if) ■ u and Brinkmann's recent proof [3] of the decidability of membership 
in ((f) ■ u. 

The orbit problems considered in this paper are of the following form: 
given an element u £ Fa, a finitely generated subgroup H of Fa and a subset 
G of Aut Fa, does H meet the orbit of u under the action of G; that is: does 
H contain (p{u) for some automorphism cp € Gl A particular instance of this 
problem, when G = fkutFA, is the question whether H contains a primitive 
element, since the set of primitive elements of Fa is the automorphic orbit 
of each letter a E A. The latter problem was recently solved by Clifford and 
Goldstein in full generality [I]. These problems were posed to the second 
author by O. Bogopolski, and they appear as Problem F39 in the list of 
open problems on grouptheo ry . inf o[ 

Our main results state that these problems are decidable in the rank 2 
free group i*2, if G = Aut F^ (Theorem 12 .3p or if G belongs to a certain family 
of rational subsets of Aut F2, which includes the rational subsets of invertible 
substitutions (a.k.a. positive automorphisms, which map each letter to a 
positive word) or of inverses of invertible substitutions, see Sections 15.11 
and 15.21 For these rational values of G, we also show the decidability of 
subgroup orbit problems: given two finitely generated subgroups H, K of 
F2, does there exist fi € G such that K is contained in (resp. equal to) 

In free groups with larger rank, we are only able to decide a weaker 
problem. Say that an automorphism ip of Fa is /c-almost bounded if |^(a)| > 
k for at most one letter a € A. We show that given k > 0, u £ Fa and H 
a finitely generated subgroup of Fa, one can decide whether there exists a 
/c-almost bounded automorphism \x such that n(u) € H. 

Some of our results hold also if we replace the subgroup H by a rational 
subset of Fa- 

We use two main methods. Some of our main results can be derived from 
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general results on the decidability of the solvability of equations with rational 
constraints in free groups (Diekert, Gutierrez and Hagenah [6], building on 
Makanin's famous result [H]). This is an interesting application of equations 
in free groups. 

For other results, we give a direct combinatorial proof. We use a partic- 
ular factorization of the automorphism group Aut F2 (Theorem 13. 4p and a 
detailed combinatorial analysis of the effect of certain simple automorphisms 
on the graphical representation of the subgroup H (the representation by 
means of so-called Stallings foldings (2U [10] , see Section II. 2p . The set of 
these automorphisms is £ = {<^ a ,6a; Vfe- 1 ^- 1 ; ^6,0} i}Px,y maps generator a 
to x and generator b to y). 

This combinatorial analysis leads to the definition of a (large but finite) 
automaton whose vertices are finite automata associated with the Stallings 
automata of the subgroups in the E*-orbit of H. The construction of this au- 
tomaton exploits the fact that a certain combinatorial parameter of Stallings 
automata (which we call the number of singularities) is preserved under the 
action of automorphisms in X. And it is the possibility of reading these 
actions on this finite automaton which yields our decidability results for the 
cases where G is a rational subset of £*. Invertible substitutions form a 
particular rational submonoid of S*. 

Interesting intermediary results state that the set of primitive elements 
in F2 is a context-sensitive language (Proposition 13.81) and that if \A\ = m 
and vx, . . . , v m -i € Fa, then the set of elements x such that v%, . . . , v m -i,x 
form a basis of Fa is a constructible rational set (Proposition 12 . 1 1]) . 

1 Preliminaries 

1.1 Free groups 

Let A denote a finite alphabet. The free monoid on A, written A*, is the 
set of all finite sequences of elements of A (including the empty sequence, 
written 1), under the operation of concatenation. We also write A + for the 
set of non-empty sequences of elements of A. 

Let A -1 be a disjoint set of formal inverses of A and let A = A U A^ 1 . 
The operation u^u" 1 is extended to A* as usual, by letting (a -1 ) -1 = a 
and (ita) -1 = a _1 u _1 for all a € A and u G A*. 

The free group on A is the quotient Fa of A* by the congruence generated 
by the pairs (aa -1 , 1), a S A, and we write 7r: A* — > Fa for the canonical 
projection. A word u € A* is reduced if it does not contain a factor aa^ 1 
(a 6 A) and we denote by Ra the set of reduced words. We also say that 
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u € Ra is cyclically reduced if uu is reduced as well. And we denote by 
cc(u) the cyclic core of u, that is, the unique word such that u is of the form 
u = v~ 1 cc(u)v in A*. 

We write u u the reduction map, where u is the (uniquely defined) 
word obtained from u by iteratively deleting factors of the form aa^ 1 (a € A) 
until none is left. It is well-known that the reduction map is well defined, 
and that the restriction ir: Ra — >■ Fa is a bijection. To simplify notation, if 
g £ Fa, we also write g for the reduced word such that n(g) = g, and we let 
the length of g be \g\ = \g\. 

Given X C Fa, we denote by (X) the subgroup of Fa generated by X. 
We also let Aut Fa denote the automorphism group of Fa- If f € Aut i 7 ^ and 
no confusion arises, we shall denote also by ip the corresponding bijection of 
Ra- 

Given B C Fa, we say that B is a basis of if the homomorphism 
from Fb to induced by the inclusion map B — > Fa is an isomorphism. 
Equivalently, B is a basis of Fa if and only if B = <p(A) for some if € Aut Fa- 
The primitive elements of Fa are those that sit in some basis of Fa- It follows 
that the set of primitive elements of Fa is the orbit of each letter a £ A 
under the action of Aut Fa- 

In much of this paper, we shall be discussing the free group on 2 gen- 
erators. We fix the alphabet A2 = {a,b} and use the notation F2 = Fa 2 , 
R2 = Ra 2 ■ 

1.2 Automata and rational subsets 

The product of two subsets K, L of a monoid M is the subset KL = {xy \ 
x € K, y £ L}. The star operator on subsets is defined by L* = U n >o 
where L° = {1}. A subset L of a monoid is said to be rational if L can be 
obtained from finite subsets using finitely many times the operators union, 
product and star. We denote by RatM the set of rational subsets of M. If 
M is the free monoid A* on a finite alphabet A, subsets of A* are called 
languages, and elements of Rat A* are called rational languages. 

Note that if (p : A* — > M is an onto morphism, then Rat M is the set of 
all <p(L) where L <G Rat A*. For instance, every finitely generated subgroup 
of Fa is rational. 

It is well-known that rational languages can be characterized by means of 
finite automata. A (finite) ^-automaton is a tuple A = (Q,qo,T,E) where 
Q is a (finite) set, qo £ Q, T C Q and E C\ Q x Ax Q. It can be viewed as a 
graph with vertex set Q (the states), with a designated vertex qo (the initial 
state) and a set of designated vertices T (the terminal states), whose edges 
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are labeled by letters in A, and are given by the set E (the transitions). 
A nontrivial path in A is a sequence 

a\ ci2 a n 
PO >Pl >■■ • >Pn 

with n > 1, (pi_i, ai,pi) E i? for i = 1, . . . , n. Its Za&eZ is the word a\ . . . a n € 
A + . We consider also the trivial path po — >po for each po £ Q, whose label 
is the empty word. A path is said to be successful if po = qo and p n € T. 
The language L{A) recognized by A is the set of all labels of successful paths 
in A. 

The automaton A = (Q,qo,T,E) is said to be deterministic if, for all 
p € Q and a £ A, there is at most one edge of the form (p,a,q). In that 
case, we write q = p ■ a. We say that A is trim if every q £ Q lies in some 
successful path. 

Kleene's theorem states that a language is rational if and only if it is 
accepted by a finite automaton, which can be required to be deterministic 
and trim, see [9]. In the context of a particular result or claim, we say that 
a rational language L is effectively constructible if there exists an algorithm 
to produce a finite automaton recognizing L from the concrete structures 
containing the input. More generally, if ip: A* — > M is an onto morphism, 
we say that a rational subset of M is effectively constructible (with respect 
to A) if it is the image of an effectively constructible rational language over 
A. 



Remark 1.1 A subset L C Fa is rational if L = ir(K) for some rational 
subset K of A*. Benois' theorem [Ij states that this is the case if and only 
if K (= -k~ 1 {-k(K)) n Ra, in bijection with L via tt) is a rational subset of 
A*. In the sequel we sometimes confuse the notions of a rational subset of 
Fa and a rational language in A* that consists only of reduced words. 



1.3 Automata and subgroups of Fa 

To discuss subgroups of free groups, we use inverse automata. In an A- 
automaton A = (Q, qo, T, E), the dual of an edge (p,a,q) G E is (q, a _1 ,p). 
Then A is said to be dual if E contains the duals of all edges, and inverse 
if it is dual, deterministic, trim (equivalent to connected in this case) and 
\T\ = 1. 

Given a finitely generated subgroup H of Fa (we write H <f g Fa), we 
denote by A(H) the Stallings automaton associated to H by the construction 
often referred to as Stallings foldings. This construction, that can be traced 
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Figure 1: A folding step, with a € A 



back to the early part of the twentieth century |19[ Chapter 11], was made 
explicit by Serre [20] and Starlings [23] (see also [10]). 

A brief description is as follows. If hi, ■ ■ ■ , h r £ Ra is a set of genera- 
tors of the subgroup H (that is, H = (ir(hi), . . . ,ir(h r ))), one constructs a 
dual automaton in the form of r subdivided circles around a common distin- 
guished vertex 1 (both initial and terminal), each labeled by one of the hi. 
Then we iteratively identify identically labeled pairs of edges starting (resp. 
ending) at the same vertex (this is called the folding process, see Figure [1]), 
until no further folding is possible. 

The following proposition summarizes important properties, see |10j . 

Proposition 1.2 Let H <f g Fa- Then: 

(i) A(H) is a finite inverse automaton, which does not depend on the 
finite reduced generating set nor on the sequence of foldings chosen; 

(ii) ifp—tq is a path in A(H), so is p—^q; 

(Hi) for every u £ Ra, u £ L{A{H)) if and only if ir(u) £ H; in particular, 

(iv) for every cyclically reduced u € Fa, wuw~ l £ H for some w € Fa if 
and only if u labels some loop in A(H). 

2 The mixed orbit problem as an equation prob- 
lem 

Our original motivation on writing this paper was solving the mixed orbit 
problem <p(u) £ H for given u £ F and H <f g F. We managed to solve it 
in rank 2, see Section 12.11 below. We also solve it in arbitrary rank, if we 
impose a restriction on the class of automorphisms, see Section 12.21 below. 

Our initial proof in rank 2 was purely combinatorial, and is presented 
in Section 15.31 below, whereas our result in higher ranks made use of a 
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result of Diekert, Gutierrez and Hagenah [6] on equations with rational 
constraints which we will discuss below. Upon reading a first version of this 
papei0, Dahmani and Girardel, and independently Enric Ventura (recalling 
a foregone conversation with Alexei Miasnikov) , called our attention to the 
fact that Diekert, Gutierrez and Hagenah's result could also be used to prove 
our result in rank 2. 

2.1 Equations with rational constraints and automorphisms 
of F 2 

A system of equations in a free group Fa, with set of unknowns X (disjoint 
from A), is a tuple £ = (ei, . . . , e&) of elements of Faux- A solution of £ 
is a morphism from Faux to Fa which maps each letter of A to itself and 
every element of £ to 1. 

A rational constraint on a system of equations with unknowns in X is a 
collection C = (L x ) xe x of rational subsets of Fa and we say that a morphism 
tp- Faux Fa is a solution of the system £ with rational constraints C if 
ip is a solution of £ and ip(x) E L x for each x E X. Diekert, Gutierrez and 
Hagenah [6J showed the following result. 

Theorem 2.1 The satisfiability problem for systems of equations with ra- 
tional constraints in a free group is decidable. 

This leads to a quick solution of the mixed orbit problem in F 2 . 

Theorem 2.2 Given u E F 2 and a rational subset L of F 2 , it is decidable 
whether or not tp(u) E L for some ip E AutF 2 . 

Proof. By a result attributed to Dehn, Magnus and Nielsen (see |22|). {x, y} 
is a basis of F 2 if and only if there exists some g E F 2 such that g~ 1 [x, y]g = 

[a,b: 1 . 

Now observe that if u E F 2 , then <p(u) E H for some ip E AutF 2 if and 
only if u(x,y) E H for some basis {x,y} — where u{x,y) denotes the word 
u in which each occurrence of a has been replaced by x and each occurrence 
of b by y. 

Thus there exists an automorphism ip such that <p{u) E H if and only 
if one of the following systems (in the unknowns x,y,v,g, and for e = ±1) 
admits a solution 

f g' 1 [x,y]g = [a,b] E 
1 u{x,y) = v 

1 aiXbr:0809A386vl [math.GR] 
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with the rational constraint that v G L. This is decidable by Theorem 12.11 
□ 

Since a finitely generated subgroup is rational (it is the star of its gen- 
erators and their inverses), Theorem 12.21 yields the following corollary. 

Corollary 2.3 Given u G F2 and H <f g F%, it is decidable whether or not 
(f(u) G H for some ip G AutF2. 

Since the primitive elements of F2 are the orbit of each letter a G A 
under Auti 7 ^, we also note the following result. 

Corollary 2.4 Given a rational subset L of F2 (e.g. a finitely generated 
subgroup), it is decidable whether or not L contains a primitive element. 

Remark 2.5 Clifford and Goldstein also proved a comparable result for 
primitive elements, by completely different methods: they show that it is 
decidable whether a finitely generated subgroup H of Fa (for any finite 
alphabet A) contains a primitive element [JJ. 

One can also consider, in the statement of Theorem 12.21 the rational 
subset of positive elements of F2 (namely, the submonoid A*). Then our 
result shows that it is decidable whether an element u G F2 is potentially 
positive, that is, whether it has a positive automorphic image. Different 
proofs of this result already appear in Goldstein [8] and Lee [TTj . 

Another idea is to consider a tuple of elements of F2 rather than a single 
element u, or equivalently a subgroup K <f g F2. 

Theorem 2.6 Let u\, . . . , € F2, L\,...,L^ G RatF2 and H, K <f g F2. 

The following problems are decidable: 

(1) whether tp(ui) G L\, . . . ,tp(uk) G for some ip G Auti 7 ^; 

(2) whether conjugates of <p(ui), . . . , tp(uk) sit in L\, . . . , L^, respectively, 
for some ip G Auti 7 ^; 

(3) whether <p>{K) C H , for some <p> G Atvti 7 ^. 

Proof. These statements are proved like Theorem 12.21 by reduction to a 
system of equations with rational constraints. 
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For (1), we consider the system 

g' 1 [x,y}g = [a,b] e 

ui(x,y)=v 1 
k u k (x,y) = v k 

in the unknowns x, y, g, v\ , . . . , V/. with the rational constraints v% G L\, . . . , v k G 
For (2), we consider the system 

g~ l [x,y]g = [a,b} £ 

h^u^x^y)^ = vi 

k h^ 1 u k (x,y)h k = v k 

in the unknowns x, y, g, h\, . . . , h k , v±, . . . , v k with the rational constraints 
vi e Li, . . . ,v k £ L k . 

Statement (3) is a particular case of (1), when u%, . . . , u k is a generating 
set of K and L\ = ■ ■ ■ = L k = H. □ 



Remark 2.7 Instead of asking whether there exists an automorphism in 
Auti 7 ^ mapping u into L, one may want to exhibit such an automorphism, 
if it exists. 

The existence question reduces to the satisfiability of equations with 
rational constraints, and Diekert, Gutierrez and Hagenah showed that this 
can be done in PSPACE [6]. One can extract from that paper a description 
of such a solution (an automorphism) as an exponential length product of 
simple automorphisms: the images of the letters may therefore have double 
exponential length. 

2.2 Beyond rank 2 

We do not know how to extend Theorem 12.21 or Corollary 12.31 to arbitrary 
finite alphabets, but we can get decidability for weakened versions of the 
problem. The first such result involves a restriction on the subgroups con- 
sidered. 

Theorem 2.8 Let u G Fa and let H <f g Fa- If H is cyclic or a free factor 
of Fa, it is decidable whether or not (p(u) G H for some ip G AutFA- 
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Proof. Let us first assume that H is a free factor of Fa, with rank k. It 
is easily verified that f>(u) G H for some automorphism <p if and only if u 
sits in some rank k free factor of Fa- This is known to be decidable: it 
suffices to compute a minimum length element v in the automorphic orbit 
of u (the so-called easy part of Whitehead's algorithm, see [13 US]) and to 
verify whether v uses at least k letters (Shenitzer [21], see also [131 Prop. 
1.5.4]). 

Let us now assume that H = (v). Without loss of generality, we may 
assume that u and v are cyclically reduced. Say that a word x is root-free if 
it is not equal to a non-trivial power of a shorter word. Then u = x k for some 
uniquely determined integer k > 1 and root-free word x, and similarly, v = 
y e for some uniquely determined £ > 1 and root-free y. It is an elementary 
verification that the image of a root-free word by an automorphism is also 
root-free. Thus, an automorphism maps u into H if and only if it maps x to 
y or y~ l , and /c is a multiple of I. Decidability follows from the fact that we 
can decide whether two given words are in each other's automorphic orbit, 
using Whitehead's algorithm [13]. □ 

The second result on a weakened version of our orbit problem involves 
almost bounded automorphisms. Given a finite alphabet A and k G N, we 
say that an automorphism tp of Fa is k-almost bounded if |y(o)| > k for at 
most one letter a G A. We let AlmB/u Fa denote the set of /c-almost bounded 
automorphisms of Fa- 

Theorem 2.9 Given u G Fa, L G Rat Fa and k G N, it is decidable whether 
or not <p(u) G L for some ip G AlmB^ Fa- 

The proof of this theorem relies on Diekert, Gutierrez and Hagenah's re- 
sult on the satisfiability of equations with rational constraints in free groups 
discussed in Section 12.11 We also require two technical results. 

Lemma 2.10 Let A = {a\, . . . , a m } and u G Ra- Then {ai, . . . , a m _ x, u} 

is a basis of Fa if and only if u = va e m w for some v,w G R{ ai ,...,a m -i} an ^ 
ee {!,-!}• 

Proof. It is immediate that if u = va e m w with v,w G R{ ai ,...,a m -i}i then 
{a±, a m -i, u} generates Fa, and by the Hopfian property of free groups 
(see [HI Prop. 1.3.5]), {a±, a m _i, u} is a basis of Fa- 

Conversely, let u G Ra contain at least an occurrence of a m or a" 1 , and 
let u = vzw be the factorization with v, w G R{ ai ,...,a m -i} OI maximal length. 
It is immediate that if H = (oi, a m -x, u), then H = (ai, a m -lj z) and 
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A(H) is equal to A((z)) with loops labelled a\, a m -i attached at the 
origin. Thus, if {a\, a m -i,u} is a basis of Fa, then A((z)) must consist 
of a single loop labeled a m , and hence z must be equal to a m or a" 1 . □ 

This leads to the following generalization. 

Proposition 2.11 Let m = \A\ and v±, . . . ,v m -i E Ra- Then 

X = {x £ Ra j (vi, . . . , i> m _i, x) is a basis of Fa} 

is rational and effectively constructible. 

Proof. First note that X is nonempty if and only if (v\, ...,v m -i) is a basis 
of a free factor of Fa- This is well-known to be decidable. Moreover, if 
X/i, then we can effectively construct an element z of X: it is verified in 
|23j that if K = (v\, ...,v m -i), then K is a free factor of Fa if and only if 
there are vertices p and q of A(K) whose identification leads (via foldings) 
to the bouquet of circles A(Fa), and in that case, if u p and u q are the labels 
of geodesic paths of A(K) from the origin to p and q, then z = u p Uq l £ X. 

Let ip € Aut Fa be defined by tp{ai) = Vi (i = 1, . . . , m — 1) and ip(a m ) = 
z. Then j; £ X if and only if (a±, . . . , a m _i, 99 _1 (x)) is a basis of Fa- By 
Lemma f2 . 1 1, this is equivalent to say that ip^ 1 (x) G R{a m U a^)R, where 
R = (oi, . . . , a m _i), and therefore 

X = ^(fl(o m U a" 1 )^) = y(z U z- l )V 

for y = (vt, . . .,v m -i). 

In particular, X is rational and the formula X = V(z U z~ l )V provides 
an effective construction for it. □ 

Proof of Theorem 12.91 Write A = {a±, ... ,a m }. Without loss of gener- 
ality, we may restrict ourselves to the case |</?(cii)| < k for i = 1, . . . ,m — 1. 
Since there are only finitely many choices for these <p(ai), we may as well 
assume them to be fixed, say (p(ai) = Vi for i = 1, ... ,m — 1. Let then 
X = {x £ Ra I (v\, . . . ,v m -i,x) is a basis of Fa}'- then X is rational by 
Proposition 12.111 

Write u = uqo^ui . . . a e ^u n with n > 0, n, € F^ ai ^ am _^ and E{ = ±1 
for every i. Then we must decide whether there exists some y € X such that 

u' y £l u[...y En u' n G L, 
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where u\ = Ui{v\, . . . , u m -i) is the word obtained from m by replacing each 
cij by Vj. This is equivalent to deciding whether the equation 

u' y ei u > 1 ...y En u' n = z (1) 

on the variables y, z has a solution in Fa with the rational constraints y G X 
and z G L. This is decidable by Theorem 12.11 □ 

As in Section 12.11 Theorem 12.91 yields a decidability result for finitely 
generated subgroups. 

Corollary 2.12 Given u G Fa, H <f g Fa and k G N, it is decidable whether 
or not (f(u) G H for some <p 6 AlmBk Fa- 

And as in Theorem 12.61 we use t he same ideas to prove the following 
theorem. If w € i*2, denotes the inner automorphism u i— > w~ 1 uw. 

Theorem 2.13 Letu\,. . . ,u m G F A , L G RatF A , H, K < fg F A and k G N. 
77ie following problems are decidable: 

(1) whether ip(ui), . . . , (p{u m ) G for some (p G AlmBk F A ; 

(2) whether X w ip(ui), . . . , X w (f(u m ) G L, /or some w G i 7 ^ and 99 G AlmBk Fa', 

(3) whether conjugates of<p(ui), . . . , ip{u m ) sit in L, for some ip G AlmBk FaI 

(4) whether <f(K) C H , for some ip G AlmBk F A ; 

(5) whether \ w (p{K) C H, for some w G Fa and ip G AlmBk Fa- 

Proof. These statements are proved like Theorem 12. 9( by reduction to a 
system of equations with rational constraints. 

For the first statement, we consider a system of equations of the form of 
equation (JTJ in the proof of Theorem 12.91 one for which Uj , 1 < j < m (the 
unknowns are y, z\, . . . , z m ). 

For the second (resp. third) statement, we consider the same system, 
with each equation conjugated by a new unknown v (resp. by distinct new 
unknowns Vj, 1 < j < m). 

The fourth and fifth statements are applications of the first and second 
when the rational subset L is the subgroup H. □ 
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Remark 2.14 Following-up with the discussion in Remark 12.71 we note 
that the complexity upper bounds for the decision problems described in 
this section are PSPACE again: we need to (attempt to) solve, successively, 
systems of equations for the different values of v±, . . . , v m -\ (with the nota- 
tion of the proof of Theorem 12.91 These (m — l)-tuples of words of length 
at most k are exponentially many (in the variable k) but they can be listed 
in polynomial space. 

3 Combinatorial approach: the role of E 

We now restrict our attention to F2. If x, y G F2, we denote by ip x y the 
endomorphism mapping a to x and b to y. In this section, we discuss some 
properties of the following sets of automorphisms of F%: 

So = {faM^b-^a- 1 } and £ = S U {<fb,a}; 

$ = {<Pa,bai <Ai&,b> fa,abi fba,b}', 

A = {ipa,a™b*a* I rn, n G Z, e G {1, -1}}; 

<Jr = {(p g AutF 2 : \<p(a)\ = \ip(b)\ = l} and A = {\ w \ w G R A ). 
The following will be useful in the sequel. 
Proposition 3.1 (i) XA = AX for every X C AutF 2 ; 
(ii) AW C AvI/(S - 1 )V a - 1>6 ; 
(in) A C A{ip* aM U <£ -i j6 <^* i6a ^ a -i >6 )(l U ^ 0i6 -i). 

Proof, (i) follows from the fact that 6\ w = \q( w )6 for each w £ F2 and 
6» G AutF 2 . 

(ii) Notice that (p ab , b = <Pb,a<Pa,ba<Pb,a, <Pa,ab = K~ ll Pa,ba and ip b a,b = 

h-i<Pab,b- It follows that A^<I>* C A^{ip aM , ip b>a }*. 

Observe also that (p aM = Pa-^bfafiaPa'^b, Pb,a = ( Pa-i,b ( P b ~-l^ a -l i Pa-i,b 
and (p 2 a -i h = 1- So we have 

Therefore A*<D* C A^ a -i i6 (Eo x )*<p a -i, h = A^(^ l )> a -\b- 
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(iii) Observe that if m,n £ Z, then (p a ,a m ba n = A a 
so that (/Ja^ba™ G A (^a,fca u (v?a,L)*)- We already noted that yf"^ = 

<Pa,a™ba™ G A(</>* 6a U <f a -l >b (f* aM <p a -l >6 ) . 

Similarly, <£ a)a m 6 -i a ™ = A a n<£~^ +n V a ,&-i and hence 
which concludes the proof. □ 

3.1 Primitive words and a factorization of AutF 2 

Let us first consider a particular automorphic orbit in Fa, namely the set 
Pa of primitive words. Recall that a word is primitive if it belongs to some 
basis of Fa- In particular, Pa is the automorphic orbit of each letter from 
A. We shall often view Pa as a subset of Ra- We denote by P2 the set of 
all primitive words in F2. 

We use a known characterization of the words in P2 to derive a technical 
factorization of the group Auti^ of automorphisms of F2, that will be used 
in Section [5l We further exploit this characterization to point out certain 
language-theoretic properties of P2. 

Proposition 13.21 reports two results: the first is due to Nielsen [16] (see 
also [5j 2.2] and [17]) and the second is due to Wen and Wen [25J. An 
interesting perspective on either is offered in [121 Chapter 2] and [21 Chapter 
1-5]. 

Proposition 3.2 (i) Up to conjugation, every primitive element u S P2 
is either a letter, or of the form u = a ni b mi ...a Uk b mk where 

- either n\ = ... = £ {1, —1} and {mi, m^} C {n, n + 1} for 
some integer n, 

- or mi = ... = rrik G {1, —1} and {ni, n^} C {n, n + 1} for 
some integer n. 

(ii) The set of positive primitive words P2H{a, b} + is equal to $>*({a,6}) = 
6U$*(a). 

Corollary 3.3 P 2 = Atf$*(a). 
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Proof. By Proposition 13.21 (i) . every primitive element of F 2 is a conjugate 
of tjj(ab mi ...ab mk ), where {mi,...,mj.} C {n,n + 1} for some integer n > 
and ip G That is, P 2 = A^(P 2 n {a,6} + ). By Proposition O (ii), it 
follows that P 2 = A^(bU $*(a)) = Atf$*(a). □ 

We can now prove a useful decomposition result for Auti^- 

Theorem 3.4 AutF 2 = A^$*A = *(Eo ^'A^fo,-^ U ¥>«-i,6-i). 

Proof. To establish the first equality, we consider 9 G AutF 2 . Then 9(a) G 
P 2 and so 6(a) = a (a) for some a G A^* by Corollary [331 Corollary I2TTTJ1 
then shows that o~~ 1 9 = (p a ,a m b s a n for some m,n G Z and e G {1, —1}. So 
(T ^9 G A and 6» G A^$*A. It follows that 

AutF 2 C A¥**($p* to U (/> a -i )6 <?* j6a </> a -i jb )(l U ^ Q)6 -i) by Proposition O 
C AW(1 U U ^6-1 ) since <^ a , fea G $ 

C AW(y? a -i ^* fea¥ ? a -i fe )(l U ^t-i) since <^_i )6 = 1 
C Att(£o 1 )V* 6o ¥'«-i I &(l U ^-1) by Proposition O(ii) 
C ^(S^ 1 )*A^ ifea (<^ a - life U 

The converse inclusion is of course trivial. □ 
3.2 Invertible substitutions 

A substitution^ of Fa is an endomorphism ip such that (f(a) G j4* for every 
a G A If y is an automorphism, it is said to be an invertible substitution. 
We denote by IS(F 2 ) the monoid of all invertible substitutions of F 2 , and by 
IS -1 (-F 2 ) the monoid of their inverses. Note that the inverse of an invertible 
substitution is not necessarily a substitution: indeed tp~\ a = faba- 1 - 

Lemma 3.5 IS(F 2 ) is a rational submonoid o/S*. Moreover, there exists 
a rational submonoid S ofH* such that IS~ 1 (F 2 ) = ip a f)-i S ipab- 1 - 

In addition, every rational subset R G RatIS(F 2 ) is also in RatT,* , and 
every rational subset R G RatIS~ 1 (F 2 ) is of the form <p a b-i Rf ^afe- 1 f or 
some R' G RatS C RatT,*. 

2 also called a positive endomorphism 
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Proof. It is known [25] that the monoid IS(P2) is generated by (pb,a, ^a,ba 
and ip a ,ab (see also [2[ Chapter 1.5], [12j Sec. 2.3.5]). But tpb^^afia £ E and 

Va.ab = Vb^b- 1 ,a- lL Pa,ba L Pb- 1 ,a~ lL Pb,a G E*, 

SO IS(F 2 ) = {y6, OJ ¥ , o,6o ) ya,o6}* G RatE*. 
Next we observe that 

</\a = ¥b,a = fafi-^b-^a-^afi- 1 

Since <~p a ,b- x has order 2, it follows that IS^) -1 = ip ab -\Rip ab -\ with 
# = G RatE*. □ 

3.3 Primitive words form a context-sensitive language 

Digressing from our main topic, we use Corollary [331 to establish a language- 
theoretic property of primitive words. 

Recall that a context-sensitive A-grammar is a triple Q = (V, P, S) where 
V is a finite set containing A, S is an element of V that is not in A and P is 
the set of rules of the grammar: a finite set of pairs (£, r) G y + x V + such 
that 

£ £A + and |£| < |r|. 

For all x, y € y + , we write x => y if there exist u,ner and (£, r) € P such 
that x = it£t> and y = urv. We denote by =>- the transitive and reflexive 
closure of =>. The language generated by Q is 

L(Q) = {w £ A + \ S => w}. 

A language L C A + is said to be context-sensitive if it is generated by 
some context-sensitive j4-grammar. As usual, a language L C 4* is called 
context-sensitive if L n A + is context-sensitive. 

The right and left quotients of a language L by a word ii are defined by 

u\Z> = {i £ 4* | ra £ L}, L/u = {x G A* \ xu € L}. 

Lemma 3.6 T/ie c/ass o/ context-sensitive languages is closed under union, 
intersection, concatenation, right and left quotient by a word, 1-free substi- 
tutions and inverse morphisms. 
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Proof. Closure under union, intersection, concatenation, 1-free substitu- 
tions, and inverse homomorphisms is well-known (9] Exercise 9.10]. In par- 
ticular, the family of context-sensitive languages forms a trio [9] Section 
11.1] and as such, it is closed under limited erasing [9] Lemma 11.2]. By 
definition, this means that if k > 1, L is context-sensitive and <p is a mor- 
phism such that <p{v) ^ 1 for each u € L and each factor v of u of length 
greater than k, then <p(L) is context-sensitive as well. 

For the quotients, it suffices to consider letters, hence let L C A*, a € A 
and $ g" A. Let a be the substitution that maps a to a(a) = {a, $} and which 
fixes every other letter of A. Let also tp: (A U {$})* — > A* be the morphism 
which fixes every letter of A and erases $. Then a\L = p{a{L) D and 
L/a = <p(o~(L) n^4*$). Since the a-images of the letters are finite, and hence 
context-sensitive, the languages cr(L) n $^4* and cr(L) n ^4*$ are context- 
sensitive; moreover ip exhibits limited erasing on these languages, so a\L 
and L/a are context-sensitive as well. □ 

Proposition 3.7 Let A be a finite alphabet and let T be a finite set of 
endomorphisms of A + . For every u € A + , T*(u) is a context-sensitive 
language. 

Proof. Take b £ A. We define a context-sensitive (A U {6})-grammar Q = 
(V, P, S) by V = A U {R, S, T} U {F v \ <p E T} and 

P = {S -> bF v uR, S -> bub 2 , F v a -> ^(a)^, F^i? -s> Ti?, 
F^i? 6 2 , aT -> Ta, 6T -> ftF^; aGi, ^ G T }. 

We show that L(0) = 6r*(n)6 2 . 

Clearly, F^u =>• ip{v)F v for all G T and u £ 4* and so 

bvTR 4- 6Tt;i? 6F^i? 4> bip(v)F^R bip(v)TR. 

bmce S =► M^ufl =5- bip(u)F v R =>■ bp(u)TR for every </? € T, it follows that 
5 4- b6{u)F v R => 66>(u)fe 2 for every 6> e T+. Together with S 1 6n6 2 , this 
yields 6r*(u)6 2 C L(£). 

To prove the opposite inclusion, let 

Z = {S 1 } U {bxyb 2 ,bxTyR,bp(x)F ip yR \ xy E r*(u)}. 

Then Z is closed under =>. That is: if X 6 Z and X Y, then Y E Z. 

Since 5 £ Z, it follows that L(0) C Z D A* = bT*{u)b 2 and so L(0) = 
bT*{u)b 2 . Thus 6r*(tt)6 2 is context-sensitive and by Lemma [3.61 T*(u) = 
b\(bT* (u)b 2 ) jb 2 is context-sensitive as well. □ 
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Theorem 3.8 P 2 is a context-sensitive language. 

Proof. Since the class of context-sensitive languages is closed under union 
(Lemma I3.6p . it follows from Proposition I3.2f ii) and Proposition 13.71 that 
P2l~l{a,6} + = P2(~l{a, b} + is context-sensitive. Moreover, Proposition I3.2f i) 
shows that P 2 = A$>(P 2 n {a, b} + ) = ^A(P 2 n {a, b} + ). Since is finite, we 
need only prove that each ipA(P 2 n {a, b} + ), ip E ty, is context-sensitive. 

Notice that, for each ip € \P and each word io, i/j(w) = tp(w). By 
Lemma 13.61 again, we need only to prove that A(P 2 H {a, b} + ) is context- 
sensitive. 

Let w € R 2 and p £ P 2 H {a, b} + . If wpw~ l is not reduced, then one of 
wp and pw' 1 is not reduced. In the first case, let q be the longest prefix 
of p such that g _1 is a suffix of w, say p = qr and u> = vq -1 . Then 
wpw~ l = vq~ 1 qrqv~ 1 = vrqv' 1 . The second case (if wp is reduced but 
pw^ 1 is not) is treated similarly. Iterating this reasoning, we find that 
wpw~ l = vp'v -1 , where v is a prefix of w and p' is a cyclic shift of the word 
p - that is, there are words q, r such that p = qr and p' = rq. 

Since P 2 n {a, 6} + is closed under taking cyclic shifts, it follows that 
A(P 2 n {a, b} + ) is the set of reduced words of the form vpv^ 1 with p € 
P 2 n{a,b}+. 

Thus, if Q = (V, P, S) is a context-sensitive ^-grammar generating P 2 n 
{a, 6}+, then A(P 2 n{a,6}+) = L(£') n R 2 , where 0' = {V',P',S') is the 
context-sensitive yl-grammar given by S' V , V = {S'} U V and P' = 
PU{S' -> S}U {S" -> cS'c' 1 ; c e A 2 U ^2 1 }. In view of the closure 
properties in Lemma I3UI A(P 2 n {a,6} + ) is context-sensitive, and hence so 
is P 2 . □ 

This result cannot be improved to the next level of Chomsky's hierarchy: 
Proposition 3.9 P2 is not a context-free language. 

Proof. We show that P2 n ab + ab + ab + is not a context-free language. Since 
the class of context-free languages is closed under intersection with rational 
languages, it shows that P2 is not context-free either. 

It follows easily from Proposition I3.2( i) that P2 n ab*ab*ab* is equal to 

^ab m ab n ab k \ m, n, k G N, max(m, n, k) = min(m, n, k) + 1 1 . (2) 

It is now a classical exercise to show that P 2 C\ab + ab + ab + is not context-free 
since it fails the Pumping Lemma for context-free languages [9l Section 6.1]. 
□ 
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4 Singularities, bridges and automorphisms in E 



We now discuss the evolution of the Stallings automaton of a subgroup H 
under the iterated action of the automorphisms in S. It is well-known that 
the automata A(ip(H)) may grow unboundedly as the length of ip (as a 
product of elements of X) grows. But in the context of the mixed orbit 
problem with respect to the automorphisms in £*, we are only interested 
in the possibility of reading a n-labeled loop (where u is a fixed word) in 
A(ip(H)): if the growth of the automata results in long stretches without 
branchpoints, then this growth does not affect the membership of u in <p(H) 
after a certain point. 

Indeed, we show that the fragments of the A(<p(H)) (ip € S*) that could 
conceivably allow the reading of a u-loop take only finitely many values - 
and these fragments (which we call truncated automata) can be organised 
as the states of an automaton on alphabet £. The mixed orbit problem with 
respect to S* then reduces to deciding whether this automaton accepts a 
non-empty language. 

We now get into the technical considerations that give substance to this 
overview of our method. Given H <f g F2, we say that a state q of A(H) is 

• a source if q ■ a, q ■ b 7^ 0, -^—q-^ 

• a sink if q ■ a -1 , q ■ b^ 1 ^ 0. -^q<^— 

Note that a source may have incoming edges and a sink may have outgoing 
edges. We use the general term singularities to refer to both sources and 
sinks and we denote by Sing(il) the set of all singularities of A(H) plus the 
origin. 

If we emphasize the vertices of Sing(iJ) in A(H), it is immediate that 
A(H) can be described as the union of positive paths, i.e. paths with label 
in (aU6) + , between the vertices of Sing(iJ), and these positive paths do not 
intersect each other except at Sing(iT). We call such paths bridges. Note 
that every positive path whose internal states are not singularities can be 
extended into a uniquely determined bridge. 

4.1 Bridges in A{H) 

The next two results are easily verified. 

Fact 4.1 The automaton .4(^-1 a -i(H)) has the same vertex set as A(H), 
edges are reverted and labels changed. In particular, sources and sinks are 
exchanged. If (3 is a bridge in A(H), (3 = p — >q, then there is a bridge 
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of equal length q — >p in .4(^-1 a -i(H)), labeled ip b -i a -i (w ), which we 
denote by ip b -i^ a -i(j3). 

Fact 4.2 The automaton A((pb, a (H)) has the same vertex set as A(H) and 
labels are exchanged. Sources and sinks remain the same. If ft is a bridge in 
A(H), f3 = p-^-q, then there is a bridge of equal length p — >q in A{(fb,a{H)) , 
labeled ipb, a (w), which we denote by ipb, a {fi)- 

Dealing with (p a ^ a is naturally a little more complex. However, as we will see 
in the next two statements, the foldings implied in computing A{<p a ,ba{H)) 
are very local: they can be performed in a single round of independent 
foldings. Moreover, sources in A{ip a ^ a {H)) were already sources in A(H) 
and sinks in A((p a £ a {H)) are at distance 1 of sinks in A{H). 

Fact 4.3 The automaton A{ip a ^a{H)) is obtained from A(H) by the follow- 
ing 3 steps: 

(51) If p—tq is an edge of A{H) and q is not a sink, we replace that edge 
by a path p — > • -^q, adding a new intermediate vertex for each such 
edge. 

(52) Ifp-^-tqi^—r is a sink in A(H), we replace this configuration by 



b 




a 



(S3) We iteratively remove all the vertices of degree 1 different from the 
origin. 

Proof. Following |18^ Subsection 1.2], the automaton A{(p{H)) may be ob- 
tained from A{H) in three steps: 

(1) We replace each edge labelled by b by a path labelled ba (introduc- 
ing a new intermediate vertex for each such edge), producing a dual 
automaton B. 

(2) We execute the complete folding of B. 

(3) We successively remove all the vertices of degree 1 different from the 
origin. 

How much folding is involved in the process? Let us consider the first level 
of folding, i.e. those pairs of edges that can be immediately identified in B. 
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• There are no 6-edges involved in the first level of folding: indeed, the 
6-edges keep their origin when we go from A(H) to B, and their target 
is always a new vertex where folding cannot take place. 

• If we have a sink p-^-q^—r in A(H), we get 

b a a 

p — > • — >qi — r 

in B and therefore an instance of first level folding, yielding 

b 

a 

• These are the only instances of first level folding: we cannot fold two 
"new" a-edges -^->q<^— in B since that would imply the existence of 
two 6-edges — >q< — in A(H). 

Let C denote the automaton obtained by performing all the instances of first 
level folding in B. It follows from the above remarks that C can be obtained 
from A(H) by application of (SI) and (S2). 

We actually need no second level of folding because C is already deter- 
ministic. Indeed, it is clear from (SI) and (S2) that configurations such as 

a a b b ■ n 

< — q — > or < — q — > cannot occur in C. 

Suppose that — >q< — does occur. Then both edges must have been 
obtained through (S2) and the origin of these edges is the vertex q ■ (ab^ 1 ) 
in A(H), a contradiction. 

Finally, suppose that -^-q^— does occur. At least one of these edges 
must have been obtained through (SI), but not both, otherwise we would 
have a configuration — >q< — in A(H). But then we would have a configura- 
tion — >qi — in A(H) and q would be a sink, contradicting the application 
of (SI). Thus C is deterministic and so A((p(H)) is obtained from A(H) by 
successive application of (SI), (S2) and (S3). □ 

Fact 4.4 (i) When applying ip a ,ba> a, state of A(H) is trimmed in step 
(S3) if and only if it is a sink of A(H) without outgoing edges. More- 
over, no consecutive states can be trimmed. 

(ii) The sources of A((p aj b a (H)) are precisely the sources p of A{H) such 
that p ■ a is not a sink or has outgoing edges in A(H) . 

(Hi) The sinks of A(<p a b a (H)) are precisely the states p of A(H) with in- 
coming edges such that p ■ a is a sink of A(H) . 
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Proof, (i) The origin cannot be trimmed and the number of outgoing edges 
never decreases, so the only possible candidates to (S3) are the states that 
see a decrease in their number of incoming edges, which are precisely the 
sinks of A(H). Their fate will then depend on the previous existence of 
some outgoing edge. Note that A(H) cannot possess two consecutive sinks 
with no outgoing edges, hence the trimming of a vertex will not be followed 
by the trimming of any of its neighbours. 

(ii) Since outgoing edges can be at most redirected through (SI) and 
(S2), it is clear that every source p of A((f a ,ba(H)) must be a source of 
A(H). Thus everything will depend on p ■ a being trimmed or not, and part 
(i) yields the claim. 

(iii) No new intermediate vertex obtained through (SI) can become a 
sink, and any sink of A{H) will not remain such after application of (S2). 
Thus the only remaining candidates are the non-sinks of A(H) that see an 
increase of their number of incoming edges, which are precisely those of 
the form q ■ a -1 , where q is a sink of A(H). Clearly, to have two distinct 
incoming edges in A(ip a t b a (H)), p = q ■ a -1 must have at least one incoming 
edge in A{H). In such a case, it is easy to check that after (S1)/(S2), p has 
indeed become a sink of A((p a ,ba(H))- We remark also that the subsequent 
trimming by (S3) does not affect the presence of singularities. □ 

Fact 4.5 Let (3 = p-^-q be a bridge in A(H) of length at least 2, and let 
w = w'cd where c,d E A. 

(i) A((p a) ba(H)) has a positive pathp——^- — >s, which extends to a uniquely 
determined bridge, denoted by Vo,6a(/5)- 

(ii) \¥a,ba(P)\ > \P\ ~ !j an d we have \<p a ,ba(P)\ = \P\ ~ 1 exactly if w G a+, 
p is a source or the origin in A(H), and q is a sink in A(H). 

Proof. Write B = p^-^r-^-s-^q. 

(i) By Fact 14. 4[ no state of the path p — : >s risks trimming. Hence it 

suffices to check that no internal state of this path can become a singularity. 
This follows easily from Fact 14.41 (ii) and (iii) . 

(ii) The inequality \(p a ,ba(.@)\ ^ | /3 1 — 1 follows at once from part (i). 
It follows also that \(p a ,ba(fi)\ = — 1 if and only if w'c € a + (otherwise 

\¥a,ba(P)\ > \^a,ba( w ' c )\ > \ w ' c \ = \P\ ~ l ) and p, s G Smg((p aM (H)) ■ Thus 
we assume that w'c G a + . 

Clearly, if p is the origin, it must remain so. If p is a source, it follows 
from Fact 14.41 (ii) that p remains a source (since p ■ a is not a sink in A(H)). 
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Finally, if p is a sink, it will no longer be a singularity in A((p a ,ba(H)) by 
Fact 14.41 (iii). Therefore p € Sing(</2 ^(H)) if and only if it is a source or 
the origin in A{H). 

Similarly, q can never become the origin or a source. Since q has in- 
coming edges in A(H), it follows from Fact I4.4l fiii) that s becomes a sink in 
A{(pa,ba{H)) if and only if s ■ a is a sink in A(H). Since the unique outgoing 
edge of s in A(H) has label d, then s 6 Sing(( / 9 ai b a (i/)) if and only if d = a 
and q is a sink in A(H). □ 

4.2 Homogeneous cycles and cycle-free paths 

Let <j(H) = max(l, source(H) + sink(H)), where source(H) (resp. sink(H)) 
is the number of sources (resp. sinks) of A(H). We call cr(H) the number of 
singularities of A(H). Note that a vertex may be a source and a sink, and 
in that case, it contributes twice to cr(H). 

We say that a path p — >r is homogeneous if w £ R a L)Rb, and it is special 
homogeneous if, in addition, it starts at a source or the origin, and it ends at 
a sink or the origin. Let hc(A) (resp. hcip(^4), shcfp(A)) be the maximum 
length of a homogeneous cycle (resp. homogeneous cycle-free path, special 
homogeneous cycle-free path) in automaton A. 

Given H <f, g , F2, we define 

60(H) = max(a(H),hc(A(H)), 
5{H) =max(5 (H),hcfp(A(H)), 
C{H) = max(5 (H),shcfp(A(H)). 

We record the following inequalities. 

Lemma 4.6 Let H </. g . F2. Every cycle or a cycle-free path labeled b k in 
A((pa,ba{H)) satisfies k < o-(H). 

b k 

Proof. Let us first assume that a = p — >q is a cycle-free path, say 

b b b 
p = q — ^1 — > . . . — >q k = q. 

Since any 6-edge obtained through (SI) must be followed only by an a-edge 
(see Fact |43]), only the last edge qt-i — >qk may be obtained through (SI), 
and the other edges arise from applications of (S2). Thus there exist edges 
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in A(H) (represented through discontinuous lines) of the form 

Pk-2 Pk-l 
A b S A 
| a / a 

I / I 

9n-2 >- Qk-1 *- 9fc 

b b 

In particular, the vertices pi, ■ ■ ■ ,Pk-i are distinct sinks in A(H), and the 
vertices q\, . . . , qk-i are distinct sources in A(H). Therefore 2k — 2 < a(H) 
and hence k < c(H). 

If a is a cycle, then not even the last edge of a arises from an application 
of (SI), and the same reasoning shows that 2k < &(H), so k < cr(H). □ 



9o ■ 



Pi 



■9i 



P2 
4 A 
I a 
I 

■^92 



Lemma 4.7 Let H </. g . F% and <p G E. T/ien 

o{<p{H))<o{H\ 
6a(<p{H)) < S (H), 

a<p(H)) < c(h). 

Proof. The first inequality is a direct consequence of Facts l4TT| 14.21 and 14.41 
By Facts 14.11 and 14.21 the other inequalities are trivial if (p = (fb a or 
t-Pb- 1 a- 1 ' We now assume that ip = ^p a ,ba- Since a((p(H)) < cr(H), we only 
need to show that the maximum length of a homogeneous cycle (resp. cycle- 
free special homogeneous) path a = p — >q in A((p(H)) (p = q in the case of 
a cycle) is at most equal to 5q(H) (resp. ((H)). 

If the label of a is b k , then Lemma 14.61 shows that k < cr(H), so k < 
5 (H) < ((H). 

Suppose now that the label of a is a k . In view of Fact 14.31 none of its 
edges was obtained trough (SI): indeed the a-edge in • — > • — >• produced 
by (SI) cannot occur in a homogeneous cycle, nor in a homogeneous path 
unless it is its first edge. But its initial vertex is not a singularity, so this 
edge cannot occur in a special homogeneous path. Hence the path a already 
existed in A(H). If a is a cycle, then k < So(H). 

If instead a is a special homogeneous cycle-free path, then Fact 14.41 (ii) 
shows that p is either the origin or a source in A(H). If q is the origin, we 
immediately get k < ((H). If instead q is a sink in A(<p(H)), then s = q ■ a 
is a sink of A(H) by Fact 14.41 (iii), and we have a path 

/ a k a 

a = p >q >s 
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in A{H). If a' is cycle- free, then k < k + 1 < ((H). If, on the contrary, 
a' is not cycle-free, then s is the only repetition since the length k prefix of 
a' , namely a, is cycle-free. If s ^ p, then q would also be a repetition since 
A(H) is an inverse automaton. Therefore s = p, so a' is a homogeneous 
cycle in A(H) and hence k < k + 1 < 5q(H) < ((H). This concludes the 
proof. □ 

Remark 4.8 Note that it is not the case that 5(ip(H)) < S(H) always holds 
when <p E S: see the case where H = (6a) and ip = <p a ,ba- 

4.3 Truncated automata 

Given H < f g F2, we consider the geodesic metric d defined on the vertex set 
of A(H ) by taking d(u, v) to be the length of the shortest path connecting 
u and v. Since A(H) is inverse, it is irrelevant to consider directed or 
undirected paths. As usual, we have 

d(u, Sing(ff)) = min{d(n, v) \ v € Sing(//)}. 

Given t > 0, the t-truncation of A(H), denoted by At(H), is the automaton 
obtained by removing from A(H) all vertices u such that d(u, Sing(ff)) > t 
and their adjacent edges. Note that this automaton does not need to be 
connected. 

We first observe that if /3 is a bridge which is long enough to be affected 
by the t-truncation of A(H), then for each ip£S, is affected by the 

t-truncation of A(tp(H)) as well. 

Proposition 4.9 Let (p 6 E, H <f, g , F 2 and K G Y,*(H). If (3 is a bridge 
in A(K) and |/3| > ((H), then \tp{p)\ > |/3|. 

Proof. The result is trivial if (p = <^-i a -i or <p = ipb^ a since in those cases, 
|</?(/3)| = (Facts I1TT1 and HT2]) . We now assume that ip = ip a ,ba- 

By Fact WM if \<p(P)\ < then /3 = p^q, where k > ((H), p is a 
source or the origin in A(K), and q is a sink of A(K). In particular, /3 is a 
special homogeneous cycle-free path, so that \/3\ < ((K). 

Since K € Y>*H, Lemma 14.71 shows that C(-^0 ^ C(H), a contradiction. 

□ 
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Theorem 4.10 Let ip e E, H < f . g . F 2 , t > %((H) and K, K' € E*(fl"). 
Then 

A t {K) = A t {K') => %(Jf)) = AM^'))- 

Proof. As in several previous proofs, the result is trivial if ip = (pb a or 
(p b -i a -i, and we may assume that ip = p a ,ba- 

By Proposition 14.91 we know that, once the length of a bridge reaches 
the threshold ((H) + 1, it can only get longer. Since t > \C,(H), t-truncation 
affects only bridges of length at least C,(H) + 1. We must therefore discuss 
the truncation mechanism for such long bridges. 

Assume that f3 = p — >q is a bridge in A(fJ,(H)) (// 6 E*) with \w\ > 
2t + 1. Then we may write w = uzv with |u| = \v\ = t. By Proposition 14.91 
the label of <p(f3) is of the form u'z'v' with = \v'\ = t and \z'\ > \z\. We 
only need to prove that u' and v' depend only on At{n(H)) and are therefore 
independent from z. 

In view of Fact 14.41 it is clear that u' depends only on At{fJ>(H)) (remem- 
ber that w = uzv is a positive word and singularities cannot move forward 
along a positive path). The nontrivial case is of course the case of q being a 
sink in A(fJ,(H)), since by Fact 14.41 (iii) a sink can actually be transferred to 
the preceding state along a positive path. We claim that even in this case 
v' is independent from z. 

Indeed, assume first that b occurs in v. Then > \v\ provides 

enough compensation for the sink moving backwards one position. Hence 
we may assume that v = a t . We claim that v' = a 1 as well, independently 
from z. Suppose not. Since we are assuming that the sink has moved from 
q to its predecessor, and (p(a l ~ l ) = a l ~ l , it follows that v' = ba l ~ l . Hence 
b occurs in w. Write w = xba m . Since ip(ba m ) = ba m+1 , and taking into 
account the mobile sink, we obtain by comparison ba m = ba l ~ l and so 
m = t — 1, a contradiction, since a* is a suffix of w. Therefore v' = a t and 
so is independent from z as required. □ 

Corollary 4.11 Let H < f , g , F 2 and t > \({H). Then the set 

X(t,H) = {A t {K) | K e E*(H)} 
is finite and effectively constructible. 

Proof. By Lemma 14.71 every automaton A(K), K G T,*(H), has at most 
o~(H) singularities. By definition of a t-truncation, every state in At(K) 
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is at distance at most t from a singularity, and hence the size of At(K) is 
bounded. Thus X(t,H) is finite. 

The proof of Theorem 14.101 provides a straighforward algorithm to com- 
pute all its elements. Indeed, all we need is to compute the finite sets 

X n (t,H) = {At(K) \KeZ n (H)} 

until reaching 

n 

X n+1 (t,H)c\Jx i (t,H), (3) 

which must occur eventually since X(t,H) = Ui>oXi(t,H) is finite. Why 
does © imply X(t,H) = U"> ^(t,i?)? Suppose that B G X m (t,H) \ 
(Uf> Xi(t,H)) with m minimal, say B = A t (<p(K)) with K G E m_1 (ff) 
and ip G X. By minimality of m, we have At(K) E U^ >0 Xi(t, H). Thus 
^ t (if) = At(K') for some if' G U™ =0 £ 4 (#). Now Theorem ED] yields 

n+I n 

B = M<P(K)) = M<P(K')) G U F ) = U ^ )' 

i=0 i=0 

a contradiction. Therefore X(t,H) = U™ >0 Afj(.£f) as claimed. □ 



5 Back to orbit problems in 

We saw in Section [2] that it is decidable whether a given element u G F2 
has an automorphic image in a given rational subset of F2 , and in particular 
in a given finitely generated subgroup of F2 (Corollary 12.31 above). We use 
truncated automata to give a different proof of this result in the finitely 
generated subgroup case. We also prove the decidability of mixed orbit 
problems under the action of certain rational subsets of £*. 

5.1 Some mixed orbit problems 

The archetypal result in this section is the solution of the following mixed 
orbit problem. 

Proposition 5.1 Let u G F% an H <f g F<i- The set of automorphisms 
ip G S* such that u G <p(H) (resp. a conjugate of u lies in (p(H)), is an 
effectively constructible rational subset o/S*. 
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Proof. Let t > max(j((H), ^\u\): if <p G E*, then u G if an d only if 

u labels a loop at the origin in A(f>(H)). Note that this is the case if and 
only if u labels a loop at the origin in At(<p(H)). 

We now view E as a finite alphabet (besides being a subset of Auti^) 
and we consider the E-transition system Bt{H) defined as follows. (A E- 
transition system is defined like a E-automaton, omitting the specification 
of the initial and terminal states.) The state set of Bt(H) is X(t,H) (see 
Corollary 14.1 1 p and its transitions are the triples At{K ) — - +At{<p(K)), for 
each At(K) 6 X(t, H) and tp G E. Note that X(t, H) is finite and effectively 
constructible by Corollary 14 . 1 1 1 and the transitions of Bt(H) are well-defined 
by Theorem 14.101 Moreover, this transition system is complete and deter- 
ministic by construction (and so defines recognizable subsets of E* as a 
submonoid of Auti 7 ^). It is immediate that if the word (ipi, . . . , ip n ) G E* 
labels a path from A t {K) to A t {K') in B t (H) (K, K' G E*(iT)), then 

Now consider the automaton formed by the transition system Bt(H) 
with initial state At{H) and terminal states the elements At{K) of X(t, H) 
such that u labels a loop at the origin in At(K) (i.e. u G K). The above 
discussion shows that the language accepted by this automaton is the set 
of words ((/?!, . . . , ip n ) G E* such that u G <f n '" Thus the set of all 

cp G E* such that u G <p(H) is rational and effectively constructible. 

Observe that a conjugate of u lies in (f(H) {ip G Auti^), if and only 
if u labels a loop at the origin in A{\ w (p{H)) for some w G F2, if and 
only if cc(u) labels a loop somewhere in A(ip(H)). We now consider the 
E-transition system Bt{H) as above, with the same initial state, and we 
take as terminal states the elements At{K) of X(t, H) such that cc(u) labels 
a loop anywhere in At(K). The language in E* accepted by the resulting 
automaton is the set of (p G E* such that p(H) contains a conjugate of u. 
□ 

The same idea — and the same transition system — can be used to 
algorithmically solve a number of other orbit problems. 

Theorem 5.2 Let H, K < fg F 2 , u,ux, ... ,u k G F 2 and R G RatT,* . Then 
the following problems are decidable: 

(1) whether u G fJ-(H) for some jj, G R; 

(1') whether a conjugate of u lies in fJ,(H) for some /U G R; that is, whether 
u G n(H) for some fi G AR; 

(2) whether K C fj,(H) for some /i G R; 
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(2') whether a conjugate of K is contained in fJ-(H) for some [i E R; that 
is, whether K C fi(H) for some fx E AR; 

(3) whether K = /j,(H) for some fx E R; 

(3') whether a conjugate of K is equal to n{H) for some [i E R; that is, 
whether K = /x(H) for some fi E AR; 

(4) whether there exist n>i , . . . , E F% such that \ Wl {u\), . . . , \ Wk (iik) E 
n(H) for some fj, E R. 

In addition, for each of these problems, the set of morphisms //EE* that it 
defines is rational and effectively constructible. 

Proof. The solutions of Problems (1) and (1') follow from Proposition l5.lt 
the set X of automorphisms ip E X* such that <p(H) contains u (resp. a 
conjugate of u) is rational and we can compute a ^-automaton recognizing 
that set. Since Bt(H) is deterministic and complete, we only have to decide 
whether X has a non-empty intersection with the given rational set R, a 
classical decidable result from automata theory. 

The other proofs follow the same pattern, and correspond to variants of 
Proposition l5.11 Let us consider Problem (2) and let u±, . . . ,Uk be generators 
of K. Then we need to consider the X-transition system Bt{H) with t > 
max(^(i?), . . . , and to choose as terminal states the elements 

A E X(t, H) such that ui, . . . , ilk label loops at the origin in A. 

For Problem (2'), we consider a cyclically reduced conjugate K' of K, 
that is, one such that the origin in A(K') has degree at least 2 (if the origin 
in A(K) has degree 1, choose any vertex v with degree at least 2 as the 
new origin and let K' be the corresponding conjugate). Let u%, . . . be 
generators of K'. Then a conjugate of K lies in n(H) if and only if the u~i 
label loops around the same vertex of A(fi(H)). Thus it suffices to choose 
t > max.(^((H), I, . . . , and to take as terminal states the elements 

A E X(t, H) such that ui, . . . , Uk label loops around the same vertex of A. 

For Problem (3), we choose again t > max(^((H), . . . , ll^fel), 
where u%, ...,Uh are generators of K. In particular, t is large enough to 
have At(K) = A(K), and we choose a single terminal state, At(K) (if 
At(K) E X(t,H); if that is not the case, then Problem (3) is decidable, in 
the negative). Then we have an automaton which recognizes the set L(t, K) 
of all such that At{n{H)) = At(K) = A(K). Observe now that trun- 

cation creates (pairs of) degree 1 vertices: the automorphisms n E L(t, K) 
are such that At(fx(H)) has at most one degree 1 vertex (the origin), and 
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hence At{^{H)) = A((j,(H)). Thus our automaton recognizes the set of all 
H G S* such that A(/i(H)) = A(K), that is, such that fi(H) = K. 

For Problem (3'), we consider a cyclically reduced conjugate K' of K 
and an integer t as in Problem (2'). Again, we have At(K') = A(K'). We 
choose as terminal states the elements of X(t,H) of the form At(\ w (K)) 
(w G F2). These automata are of one of the following types: 




form (a) form (b) form (c) 



with \x\ < t and \z\ = t. As in the discussion of Problem (3), the existence 
of a //-labeled path in Bt(H) from At(H) to an automaton of type (a) or 
(b) shows that fi(H) is a conjugate of K', and hence of K. If the path in 
Bt(H) ends in an automaton of type (c), then /J,(H) is a conjugate of K' of 
the form zyxwK' (zyxw)^ 1 or z~ 1 yxwK' \z~ 1 yxw)~ 1 for some y, w such that 
zyxw or z~ 1 yxw is reduced. We then conclude the proof of the decidability 
of Problem (3') as usual. 

Finally, for Problem (4), we choose t > max(^((H), ^\cc(ui)\, . . . , i|cc(iifc)|) 
and we choose as terminal states the elements A G X(t,H) such that each 
cc(ui) (i = 1, . . . , k) labels a loop at some vertex in A. □ 

We can also consider finitely many subgroups Hi in (4) and many other 
variations. 

A simple rewriting of Theorem 15.21 in terms of orbit problems (see the 
introduction) yields the following corollary. 

Corollary 5.3 Let H <f g F2, u G F2 and R G RatT.* . Then it is decidable 
whether the orbit of u under the action of R~ l (resp. AR^ 1 ) meets H. 

If in addition K <f g F2, then it is decidable whether H contains an 
element of the orbit of K under the action of R~ l or Ai?" 1 ; whether H is 
contained in an element of the orbit of K under the action of R or AR; and 
whether K is an element of the orbit of H under the action of R, R , AR 
or AR^ 1 . 

Applying Corollary 15.31 to the case where u is a letter in A, we get a 
statement about primitive elements. 

Corollary 5.4 Let H <f g F2 and R G RatT,* . Then it is decidable whether 
H contains a primitive element of the form \i(a), fi^ 1 G R (resp. pT x G AR). 
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Remark 5.5 Let S be a subset of R2 such that, for each rational set S' , 
one can decide whether SnS' is empty or not. Then Problems (1'), (2') and 
(3') in Theorem 15.21 are decidable even if we restrict the conjugating factors 
to be in S, that is, if we replace A by {X s \ s E S} in the statement of these 
problems. The same restriction can be imposed to A in the statements of 
Corollaries 15.31 and 15.41 

Similarly, Problem (4) in Theorem 15.21 remains decidable even if we re- 
quire the Wi to be in fixed subsets Si (i = 1, . . . , k) such that, for each 
rational set S', one can decide whether Si H S' is empty or not. □ 

5.2 Orbits under invertible substitutions 

Invertible substitutions are an interesting special case of the rational subsets 
of AutF 2 discussed in Section loTTl This leads to the following statement. 

Corollary 5.6 The problems discussed in Theorem 1 5. 2\ and Corollaries \5.3\ 



and \5.4\ are decidable also if R is assumed to be a rational subset of IS^Fz) 




or ISiFi)- 1 . 

Proof. If R e RatIS(F 2 ), then R € RatS* by Lemma [33| and we simply 
apply Theorem 15.21 and Corollaries 15.31 and 15.41 

If R e IS _1 (F 2 ), then R = ip a>b -i R 1 tp^-i for some R' £ RatE* by 
Lemma 13.51 (R' is the set of inverses of the elements of R). Problem (1) 
in Theorem 15.21 on instance u, H and R, for example, is equivalent to the 
same problem on instances ^p a ^-i(u), 5-1 (if) and R' , which we know to 
be decidable. The other problems are handled in the same fashion. □ 

5.3 Another solution of the mixed orbit problem for AutF 2 

Our proof relies on truncated automata and Theorem 13.41 The key is to 
bound the powers of (p a ,ba that we need to consider, and is achieved in view 
of our previous bound for the length of homogeneous cycles. 

Let u € F2 and H < f_ g , F2. We want to show that it is decidable whether 
n{u) € H for some fi € Auti 7 ^. By Theorem 13.41 and since = *, it 
suffices to decide whether there exist w G F 2 and n > such that one of the 
following conditions hold: 
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Since is finite, it suffices to be able to decide whether 

there exist w G F2, n > and /ig Eg such that \ w ip™ ha (u) G fJ>(H). (4) 

We start by considering the case n = 0. By Proposition 13.11 (i), we may 
replace ^w^ba ^ f^ba^w so we ma y assume that u is cyclically reduced. 
And by Proposition 11.21 (iv), our problem further reduces to asking if one 
can decide whether 

u labels a loop in A(/i(H)) for some \x G Sq. (5) 

We note that every loop contains either the origin or a singularity: if it does 
not contain the origin, then there is a path from the origin to a state in the 
loop, and the first contact between that path and the loop is a source or a 
sink. Now let us fix t > max(^(if), ^\u\): then u labels a loop in A(/j,(H)) 
if and only if u labels a loop in At{^(H)). By the appropriate variant of 
Corollary 14.111 (where £ is replaced with Sq) we can effectively compute the 
finite set 

X (H) = {A t {K) I K G 

Thus © is decidable, and hence ^ is decidable for n = 0. It is also 
decidable for any fixed n (applying the case n = to 9?™& a (w) instead of u). 

We now consider dH) in its full generality. If u € R a , then we are reduced 
to the case n = since tp a ,ba( u ) = u - S° we assume that b or ft -1 occurs in 
u, and by conjugation again, we may assume that u starts with b or ends 
with b~ l (and not both since u is cyclically reduced). 

Let M be the least common multiple of 1, 2, ... , 5q{H). In order to prove 
((!]), it suffices to show that 

if there exist w € F2, n > and \i 6 Sq such that A lu (^" f)a (n) € 
fJ-(H), then there exists such a triple (w,n,fj,) with n < \u\ + 
max(M, £(#)). 

Since we have proved (|3J) for bounded n, the latter property is decidable, 
and hence ([!]) is decidable in general. 

So we are left with the task of proving this reduced claim. Let (w, n, /x) 
be such that A w c/?™ ba (w) G fJ,(H), with n minimal, and let us suppose that 
n > \u\ + max(M, 8(H)). 

Write u = a H) b £l a 11 ...b Sk a %k with k > 1 and ££ = ±1 for every £. If 
m > 0, then 
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with 

il + m if en = E£ + i = 1, or £ = k and = 1 

3l = \ it — rn if = Ee+i = —1, or £ = and £\ = —1 

^ in all other cases. 

Recall that u is cyclically reduced, and that it starts with b (ig = and 
Ei = 1) or ends with b~ l (ik = and £k = —1). It follows that (p a ,ba m ( u ) * s 
cyclically reduced and that it too starts with b or ends with 

By Proposition 11.21 (iv). ^fea( n ) labels a 1°°P a i n A(fi(H)). Moreover, 
we have 

= « ro & £l « ri • • • 6 efc o P S = a' ^ ' 1 • • • 

with 

^ = H + se = r£ — M if = e^ +1 = 1, or I = k and = 1 
re = ie — n, se = re + M if = e^+i = — 1, or £ = and £\ = — 1 
= = Z£ in all other cases. 

In the first and second cases, |r^| > n — \u\ > max(M, 5(H)); and in the last 
case, 1 < |u|. Thus, for the indices £ such that re ^ si, we have re > 6(H). 
We now show that the fragments of the loop a labeled by the factors a re 
such that n ^ se, fail to be cycle-free in A(fJ,(H)). 

Recall that fi E Eg. If ^ = id or ip b -i a -i, the result is immediate 
since > 5(H) = 5(fi(H)). If fi = ip a fia v with v € Eg, then we can use 
Proposition ^. II (i) to reduce n, a contradiction. Hence we may assume that 
fi = (Pb- 1 ,a- ll/ with v € Eg, ^ 7^ 'd- Since a _ x = id, we may further 
assume that [i = (pf,-i a -±(p a ,ba v ' with v' £ Eg. Then the vertices involved 
in the a rf -labeled fragment of a form a path in A((p a ^a v ' (H)) labeled V 1 . 
Since re > 5(H), we also have re > cr(H) > a(v'(H)) (Lemma I4.7P , and 
hence this path is not cycle- free by Lemma 14.61 

So, for each £ such that re ^ se, the fragment of a labeled by the factor 
a r ' e of <Paba( u ) f ans t° be cycle- free, and must be read along a cycle of 
A(n(H)) (in an inverse automaton, if a homogeneous path contains a cycle, 
then it reads entirely along that cycle). 

By definition, M is a multiple of the length ce of that cycle. Now compare 
VaL M ( n ) and L Paba( u ) : wherever the a- factors a Te and a Sl are different, their 
difference is either a M or a~ M , and hence it consists of a whole number of 
passages around the length ce cycle. Therefore f^/ba^i 11 ) labels a path in 
A(fi(H)) as well. This contradicts the minimality of n and completes the 
proof. 
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Remark 5.7 The a priori complexity of the algorithms discussed in Sec- 
tion [5] is very high: if it has length at most n and A(H) has at most n states, 
then a(H),(^(H) < n and the truncated automata can have exponentially 
many states. There can therefore be super-exponentially many truncated 
automata, forming the states of the transition system Bt(H) - in which we 
must solve a reachability problem (polynomial in the number of states of 
the transition system). 
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